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Abstract 

As a first step toward realizing a dynamical system that evolves 
while spontaneously determining its own rule for time evolution, func- 
tion dynamics (FD) is analyzed. FD consists of a functional equa- 
tion with a self-referential term, given as a dynamical system of a 
1-dimensional map. Through the time evolution of this system, a dy- 
namical graph (a network) emerges. This graph has three interesting 
properties: i) vertices appear as stable elements, ii) the terminals of 
directed edges change in time, and iii) some vertices determine the 
dynamics of edges, and edges determine the stability of the vertices, 
complement arily. Two aspects of FD are studied, the generation of a 
graph (network) structure and the dynamics of this graph (network) 
in the system. 

Keywords: Function dynamics; Iterated map; Self-reference; Dy- 
namical network 



1 Introduction 

In studying biological, linguistic, and social systems, one is generally inter- 
ested in understanding how a rule for the temporal evolution of a system is 
organized through the dynamics of the system itself. To construct a model 
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of such a system as a dynamical system or to simulate it using a computer, 
however, we need to supply a rule for the temporal evolution of the system. 
It would thus seem that the goal of understanding the spontaneously emer- 
gence of such a rule in biological systems through such modeling is difficult 
to achieve. 

For example, in a dynamical systems approach to the modeling of such 
a system, a rule governing the evolution of a set of variables takes the form 
of a set of equations. Then, in a naive attempt to realize the goal stated 
above, we may introduce a dynamical system describing the evolution of 
these equations, as a 'rule forming' dynamics. However, the resulting 'dy- 
namical dynamical system' would be nothing but a high-dimensional dynam- 
ical system. With the same goal in mind, then, we would need to introduce 
another dynamical system to describe the change undergone by this high- 
dimensional system. We thus see how a naive attempt to realize the spon- 
taneous emergence of a fundamental dynamics-governing rule results in an 
infinite hierarchy of systems and necessarily meets with failure. 

In this paper, we consider a model with the potentiality to form such 
a hierarchy spontaneously within an infinite-dimensional dynamical system. 
We will show that low- dimensional dynamical systems are generated from 
the original infinite-dimensional dynamical system. The generation of such 
low-dimensional systems constitutes the generation of a dynamic-governing 
rule. We elucidate the mechanism for this rule generation. 

To serve the present purpose of studying biological systems, The func- 
tion dynamics (FD) that we previously introduced [|3| is reformulated 
in Sec. 2. In this FD, we adopt a functional equation having a 'self-reference' 
term, i.e., a term including composition of a function (say / ° /). With 
this term, it is shown that a rule governing the dynamics of partial func- 
tions restricted to certain intervals is generated. This rule is determined by 
partial functions on other intervals. With this relationship among partial 
functions, low-dimensional dynamical systems are formed from the original 
infinite dimensional dynamical system. Accordingly, the function dynamics 
of the original system can be interpreted as dynamics over partial functions. 
From this point of view, the partial functions can be considered elements 
in a self-organized, low- dimensional system that evolves together while mu- 
tually generating rules that govern each other's dynamics. We first demon- 
strate that function dynamics generates rules hierarchically among partial 
functions. Then, we find that the relationships among partial functions are 
sometimes entangled, in the sense that one partial function gives a rule for 
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some other partial functions, which give a rule for the original partial func- 
tion. The formation of successive rules for low- dimensional systems and this 
entanglement of rules is analyzed. 

In Sec. 3, formation of low- dimensional dynamical systems is studied, and 
in the Sec. 4, the dynamics of the low- dimensional system are investigated. 
A summary and discussion are given in Sec. 5. 

2 The Model and Its Basic Features 

Let / be a 1-dimensional map, J — ► J. We define a map from the 1- 
dimensional map / to a new 1-dimensional map as ^ e {f) = (1 — e )id + £ f ■ 
Here id is an identity function and e is a constant (0 < e < 1). This map is 
well defined if /(I) C / is satisfied. We define a FD system employing such 
/ and \I/ as follows: 

fn+1 = Ve(fn) ° fn = (1 ~ e)f n + ef n O f n . (1) 

This equation determines the evolution of the function /„. If the initial 
function / satisfies fo(I) C J, the temporal evolution, i.e. f n (n = 1, 2, • • •), 
is determined. 

The evolution equation of a function is generally an infinite-dimensional 
dynamical system. Among the class of systems consisting of such function 
dynamics, the existence of the 'self- referential' term /„ o /„ is the distin- 
guishing feature that characterizes the system (1). This composition term 
fn ° fn determines the temporal evolution of f n , and it is an operation in 
the functional space. With this term, the rule governing the evolution of a 
functional value at a particular value of its argument depends on the values 
of the function taken at other values of the argument. 

Next, we give an example of the temporal evolution of f n determined by 
(1). Here we set the initial function /o(x) = sin 2 (1.57rx) and e = 0.55. In 
Fig.|I], the graph of f n for certain values of n are displayed. We find that 
after a transient, f n exhibits a temporal oscillation with a period of 2 time 
steps. In this example, the total function falls on a period-2 attractor in 
the functional space. However, for some other values of e, more complicated 
behavior appears. In general, it is not easy to fully explore all the phenomena 
displayed by our model by computer simulation alone. 

To carry out a numerical computation for the above FD, it is necessary 
to divide an interval into a finite number, M, of mesh points. For exam- 
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(a) (b) 




0.2 0.4 x 0.6 0.8 1 0.2 0.4 x 0.6 0.8 1 



(c) (d) 




0.2 0.4 x 0.6 0.8 1 0.2 0.4 x 0.6 0.8 1 



Figure 1: An example of the time evolution described by (1) with /o(x) = 
sin 2 (1.5-7rx) and e = 0.55. Graphed here are (a) /o and /i, (b) /2, (c) /iooo and (d) 
/iooi- The mesh size is M = 4000. In this example foo is on a period-2 attractor in 
the functional space. The arrows in (c) and (d) are included to make the period-2 
oscillation easily recognizable. Later, the graph of f n oscillates between the forms 
shown in (c) (for even n) and (d) (for odd n). 
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pie, / = [0, 1) could be divided into subintervals as P = [i/M, (i + 1)/M) 
(i = 0, . . . , M — 1). However, the composition term often causes a folding 
of the graph of the function at each time step, as shown in Figs.l (a) and 
(b). For an initial function with a single hump, the number of foldings can 
increase approximately in proportion to 2 n . Hence, finer and finer structures 
can be generated in the graph of f n , and as a result the outcome of the simu- 
lation can have a strong dependence on the mesh size M. Because the folding 
effect generates infinitesimal (Cantor-set-like) structures [[| with a variety of 
scales, it is difficult to study this system by direct computer simulation. 

In general, the following relations are fundamental for the study of FD: 

• If f n (x') = f n (x") is satisfied at some n, then f m (x') = f m (x") Vm > n 

• A fixed point of f n [f n (q) = <?] is n-independent [i.e., f n (q) = q implies 
f m (q) Vm > n]. 

We denote the set of fixed points of a 1-dimensional map / by Fix(/). 
Note that a point x' $ Fix(/ n ) satisfying f n (x') — q e Fix(/ n ) is also n- 
independent in the FD. In other words, if the value of f n at a point is equal 
to a fixed point, then this point is also n- independent. The set of all such 
n-independent points [including all points in Fix(f)] is denoted fl(f). 

3 Network Structure 

In Figs.|l](c) and (d), each f n seems to be a piecewise constant function (that 
is, the graph of /„ consists of flat pieces). This property is not peculiar 
to this initial function, but is rather general. Although we have simulated 
Eq.(l) using a variety of initial functions, in all cases, the function f n for 
sufficiently large n consists of a set of constant partial functions. (Strictly 
speaking, f n approaches such a form asymptotically as n — » oo.) Thus we 
find through our computer simulations that the number of elements of the 
setQ {f n (i/M)} (i = 0, . . . M - 1, with n fixed), \{f n (i/(M - 1))}|, satisfies 
\{fn(i/(M — 1))}| <C M for large n, in the computer simulation [|TJ. 

In this section the generation of flat pieces in the graph of f n is studied. 
Because FD consists of dynamics of a 1-dimensional map, to avoid confusion 

1 Hcre we denote the number of elements of a set A as 
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between the function on the interval / and that on the functional space, we 
define some useful notation. 

• A "partial function /„|a" is a function defined on an interval A (A C i"), 
and fnU{x) = f n {x) for x G A. 

• A "fixed point of /„" means a fixed point of the 1-dimensional map f n . 
A "fixed point of the FD" means a 1-dimensional map /„ satisfying 
that f n+1 = f n . 

• If a partial function f n \A satisfies f m \A = /nU ^ m > n > we sa y that 
"/nU ^ s ^--independent". 

• The statement "/nU i s a constant function" means that f n (A) = c 
(where c is a real number) for fixed n. It is important to keep distinction 
between the statements u f n \A is a constant function" and u f n \A is n- 
independent" clear. 

• The term "temporal evolution" refers to that of the function /„ (i.e., 
/o, /i, . . .). It does not refer to the dynamics of the 1-dimensional map, 
given by x m+l = f n (x m ). 

• We define a network for the function / n , in order to describe a graph of 
/„ in terms of graph theory. In general, a network consists of elements 
(vertices) and edges. Throughout the paper, we use A in reference to 
connected entire intervals (i.e., intervals of constant f n \A that are not 
proper subset of any other such intervals). We consider each interval A 
as an element (i.e., vertex). We consider a directed edge to be associ- 
ated with f n \A and A and denote it f n \A — > A. A dynamical "network" 
consists of elements formed through time evolution and edges whose 
terminals change in time. 

3.1 Stability around a Fixed Point 

Now we discuss how a constant partial function is formed in FD and study 
its stability. First, we consider an initial function fo(x) = a (x — q) + q, 
around the fixed point q. The evolution equation of the slope a n is easily 
found to take the form a n+ i = (1 — e)a n + ea n 2 . This 1-dimensional map 
has fixed points a n = and 1, with a n = stable and a n — 1 unstable. 
The basin of the fixed point is (—1/e, 1). Thus if f n '(x) is constant and 
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the relation — 1/e < f n '(x) < 1 is satisfied on A around a fixed point, then 
&n = fn'( x ) — ¥ as n — > oo and hence foo(x) = q. Thus, the slope of the 
graph of /nU(^) goes to 0. 

The following theorem has been proved || . 

Theorem. Consider the function d(x) = -j-(x — q) + q. If / n (x) is 
continuous around a fixed point q (on the interval q G A C J) and satisfies 
the conditions 

(i) (d(x) - f n (x))(x - f n {x)) < for x G A \ {q}, 

(ii) / n (A) C A, 

then /nU(^) — >■ q as n — > oo. 

l 

0.5 

y o 

-0.5 

-l 

-1 -0.5 0.5 1 

x 

Figure 2: If the graph of a continuous function is contained within the shaded 
area around the fixed point q in the figure, the function converges to a constant 
foo(x) = q- Here, fo(x) = — sin(7rx) (q = 0) and e = 1/4. 

In Fig.|2], the assertion of this theorem is depicted graphically. 

As n increases, the number of fixed points of /„ increases (see Fig.|T]). If 
the conditions stated in the theorem are satisfied around a fixed point, the 
graph of the function around this fixed point becomes flat as n increases. 
However, this does not necessarily imply that /„ always converges to a piece- 
wise constant n-independent function. We give counterexamples in the next 
subsection. 
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3.2 Generated Map 



We investigated the FD using a 'generated map' in earlier papers @|§. This 
generated map is defined as 

0„ = *(/„) = (l-e)id + e/ n . (2) 

This map is determined by f n . (We use the term 'generated' here because 
g n is generated from f n .) Using this map, the FD (1) can be represented by 
fn+i = 9n(fn)- F° r eac h x, the value f n +i( x ) is determined by the equation 
fn+i( x ) = <7nU($/) (where y = f n (x) and y e A). Also note that the value 
g n \A is determined by f n \A- (In the following discussion, we also use the term 
'drive', as in the phrase l f n (x) is driven by g n \A i an d the term 'refer', as in 
l f n (x) refers to A\) 

Let us rewrite the g n (x) in the form g n (x) = (1 — e)(x — f n (x)) + f n {x). 
This form is useful to prepare a suitable initial function f . If f n (A) = c, 
then g n \A(x) = (1 — e)(x — c) + c. The graph of this generated map is a 
segment contained in the line of slope 1 — e that crosses the identity function 
at c. Examples of (a) a graph of f n (x) and (b) the corresponding generated 
map g n (x) are displayed in Fig|| For f n (x) G A, f n+1 (x) is determined by 
f n+ x(x) = g n \A ° fn(x). If the attractorQ of the generated map g n is not a 
fixed point, an n-dependent function f n (x) can exist. 

Choosing a suitable fo, it is possible for the map g n generated from an 
rz-independent f n \n to have a periodic attractor. The typical generated map 
on £l(f n ) is a piece-wise linear map of slope 1 — e. The most general one is 
given by the Nagumo-Sato map, 



x n+ i = (1 — e)x n + w mod 1, < e < 1. 



This map is generated from the initial function, 

f(x)-i « fOT * e [°> U {?} m 

Note that each partial function is constant here. 



2 Here the word 'attractor' is used in a rather broad sense, because g n can be an n- 
dependent function. 
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(a) (b) 



Figure 3: Examples of a graph of (a) f n {x) and (b) its generated map g n (x). 
Here f n \n{x) € Fix(/ n ) and therefore / n |n is an n-independent partial function. 
/n(^) C fJ, and thus / n+ i|* = g n \n o / n |$. The slope of g n |n is 1 - e. In this 
example, e = 3/5. The thin broken line crosses the identity function at f n {x) and 
has slope 1 — e. 




3.3 Emergence of Elements 

In the Subsection 3.1, we stated a theorem asserting the stability around 
a fixed point, and in Subsection 3.2, we introduced the generated map. To 
close the present section, we now study the emergence of a piecewise constant 
function. 

If f n (x) is constant around a fixed point q (on A = [q — a,q + b]), the 
corresponding generated map is given by g n \A{x) — (1 — e)(x — q) + q. This 
generated map crosses the identity function at q with slope 1 — e and has a 
stable fixed point q. Thus, if there is a subinterval B (B U A = 0) on which 
fn{B) C A is satisfied, then f n (B) —>■ q as n — > oo, and a new flat part is 
generated. This constant function is n-independent (i.e. A, B C fl). 

Since the generated map of a constant partial function / n |$ Q has slope 
\ — e. As long as the values f n (x') and f n {x") refer to $, the difference 
between them decreases by the factor 1 — e per iteration. That is, if f n {x") = 
f n (x') + S, and f n (x') and f n {x") refer to $, then |/ n+ i(x') - f n+1 (x")\ = 
(1 — e)\f n (x") — f n (x')\ = (1 — e)8. From this consideration, is expected 

3 This interval $ is not necessarily identical to £7. 
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to be a piecewise constant function. In fact, all computer simulations carried 
out to this time support this conjecture.f]. 

From the graph theoretical point of view, the function f n is regarded as 
a graph with vertices x' and directed edges x' <— f n ( x ')-f\ m FD, a vertex 
corresponding to a flat piece is regarded as a single 'element', while an edge 
changes in time, according to the dynamics of f n (x'). The evolution rule 
for edges is determined by the generated map, which is determined by the 
elements. In the next section, a class of network dynamics exhibited by FD 
systems is studied. 

4 Dynamical Network 

In the previous section, the emergence of 'elements' was discussed. There, 
it was seen how as n — > oo, a function /„ approaches a piecewise constant 
function, with each constant piece regarded as an element in a network. Each 
constant partial function determines one linear part of a piecewise linear gen- 
erated map with slope (1 — e). The generated map determines the dynamics 
of the edges. In this section, we study these dynamics. 

4.1 Choice of the Initial Function 

As illustrated for a particular case in Fig.|l], we have found that beginning 
from most continuous initial functions, f n evolves forward a limit function 
with a shape that is too complicated to be computed. As long as we are 
interested in complex dynamics, however, we need to study the rather com- 
plicated generated maps that are formed generally through such temporal 
evolution. 

We start by considering computer simulations to obtain a very rough 
sketch of the functional space. In Fig.|], we display three initial functions (-1) 
and the corresponding rough phase diagrams obtained numerically (-2). In 
these phase diagrams (-2), the horizontal axis represents e, and the vertical 
axis represents a parameter characterizing fo(x), which becomes a steeper as 

4 The partial function /o(^)|a = x is also n-independent. If we start from this identity 
partial function, it is maintained under the FD. However, a slight perturbation from it 
leads to a piecewise constant function. 

5 Note that the direction of an edge is opposite to the direction of the mapping (see 
Sec.4.2). 
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Figure 4: Phase diagram (-2) regarding the behavior of the attractor of f n , 
starting from the initial functions displayed in (-1), obtained through numerical 
simulations using the mesh number M = 6000. Dots are plotted at points (r, e) 
in (a) and (k, e) in (b) and (c) in the case that f n does not converge after 1000 
steps. In (a-1), f (x) = rx(l - x), r = 3.8. In (a-2), u(x) = 2 + \. In (b-1), 
/ (x) = (1 - k)x + fesin 2 (|7rx), k = O-Q^n (b-2), u(x) = ^^(1 + |). In (c-1), 

fo(x) = x + ^sin(2^mx) [if f (x) < 0, fo(x) = 0, while if f (x) > l,fo(x) = 1], 
m = 5, k = 1.5. In (c-2), u(x) = ^(1 + |). 



the value of this parameter increases. In this diagram, a dot is plotted in 
the case that f n does not converge to an n-independent function after 1000 
steps (which is generally sufficient for transient behavior to have died out). 
In other words, for a parameter set indicated by a dot, the attractor of f n is 
time dependent, while at all other points, f n converges to an n-independent 
function. 

Recall that the stability around a fixed point depends on e (see Sec.3.1). 
The stability criterion curve given in Sec.3.1 is also plotted in Figs. 4. (-2). 
Below this curve, the fixed points indicated in (-1) are stable (while above 
the curve they are unstable), and therefore here the graph around the fixed 
point converges to flat pieces. 

If the graph around a fixed point q (q G A) is flat, then all f n (x) G A 
converge to q as n — > oo. As shown in Fig.^, the stability around a fixed 
point plays an important role in determining whether f n is n-dependent or 
n-independent .0 

To avoid the complicated effect of the folding of the graph of f n , and to 
focus on the dynamics of the network, we choose an appropriate piecewise 
constant function as the initial function / . Let / be divided into N non- 
overlapping subintervals P (I = Uq~ 1 P and P(lP = 0). The initial function 
is chosen as 

N 

fo(x)=J2* l ol P (x)- (4) 

Here, the indicating function is defined as 

1 x G P 



l p (x) 



x £ P 

and fo{P) = a l o- In this section, we consider the case in which the a*o are 
chosen randomly, using a uniform distribution on [0, 1]. 

Although the above initial function may seem too simple or too special 
to study the network dynamics of a FD system, in fact this is not the case. 

• As mentioned in the previous section, a continuous f n approaches a 
piecewise constant function (consisting of a finite or infinite number of 
pieces) as n — > oo. 

6 As shown previously, there is a gap between the stability criterion curve of the 
fixed point and the boundary between the phases corresponding to ?i-dependent and n- 
independent functions. Probably this gap can be reduced by considering the fixed points 
of /li fit ■ ■ •) successively, and by using a proper renormalization procedure However, 
this has not yet been successfully carried out. 
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• To study the dynamics of f n , determining the stability around a fixed 
point is important. If a continuous partial function is unstable on both 
sides of a fixed point q for all n, then the value of the partial function 
does not converge to q. In such a situation, we believe that partial 
functions f n \[ a ,g) an d /n|(?,6] approaches a constant function and do not 
take the value q. 

Of course, the set of limit functions resulting from the set of all continuous 
initial functions is not identical to that resulting from the set of all piece- 
wise constant initial functions. However, the limit function realized with a 
piecewise constant initial function takes finite number of values (if N is fi- 
nite), and each partial function displays periodic motion with finite period 
(because g n ' = 1 — e < 1). This implies that there exists a continuous initial 
function h that satisfies Hq\a = /nU 011 the set A = {f n (I 1 )} (f° r ah i after 
the transient behavior has died out). 

4.2 Classification of the Dynamical Network 

Using /o as defined in the previous subsection, we numerically computed the 
temporal evolution of f n . In Fig.[^, two typical results (excluding transients) 
are displayed. In this set of simulations, we choose N = 30 and e = 0.1. 
We find that some neighboring subintervals are mapped to the same value 
after the transient behavior has ended, i.e., f n (I l ) = fn(I l+l ) for sufficiently 
large n. In this case, these subintervals join to form a new subinterval. In 
such situation, the indices of the subintervals are renumbered. [Hence the 
maximal value of the index % for the subintervals P can become smaller than 
N - 1 (26 in Fig.|(a) and 24 in Fig.|(b)).] 

For most initial functions, f n {x) falls on an attractor rapidly (by n ~ 100). 
In Figs.|5](-1), the graphs of /„ {n = 1000-1010) are overlaid. As three typical 
examples we show the behavior of f n \ie, f n \p and / n |/i3 specifically. In (a-1), 
the period of f n \je, is 5 and the period of f n \p and / n |/i3 is 10. In (b-1), the 
period of all periodic partial functions is 145. Although there seems to be 
no easily discernible difference between two time series, there is a significant 
difference between the structures of their networks. 

We now set out to describe the function dynamics in terms of network 
dynamics. First, let S n (i) be a function mapping a set of indices to itself. 
We define S n (i) and S(i) as follows: S n (i) = j if /„(/*) C P and S(i) : = 
Un S n+m (i) for sufficiently large n and m. In other words S{i) is the set of all 
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(a-1) 
lr- 

0.8 

0.6 

f n (x) 

0.4 
0.2 

°Jf 

(b-i) 
i r 

0.8 ■ 

0.6 
f n (x) 

0.4 
0.2 

Figure 5: Two typical results are displayed in (a) and (b) for tha case e = 0.1. 
Each partial function plotted is on the attractor. In both cases, the simulation 
started from a random piecewise constant /o- I n the graphs of f n n = 1000- 
1010 are overlaid. In (-2), the corresponding network is displayed. The index 
i with a filled circle indicates that f n \p is n-independent, while that with an 
unfilled circle indicates that f n \p is n-dependent. A square drawn with a broken 
line indicates a set of indices A that satisfies 5(A) C A. (a-1) The period of f n \ja 
is 5 and the period of f n \p and /„|/i3 is 10. (b-2) The period of all periodic 
partial functions is 145 (although the phase of the oscillation is different for each 
subinterval) . 
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S n (i) after transient behavior. A directed edge a — > b in Figs.|5|(-2) is drawn 
iiaeS(b).f\ 

Now, let A be a set of indices. Here, two classes of A are important for 
later discussion. 

• i) The class for which S(X) C A. In this case, f n \n (i G A) evolves 
independently. This means that the time evolution of f n \n (i G A) is 
not influenced by a perturbation applied to the value of f n \p for any 
3 t A. 

If two sets of indices Ao and Ai satisfy this condition and if Ao C Ai, we 
say that 'Ao and Ai' are hierarchical. Q In this situation, a perturbation 
applied to f n \p (i G A ) can influence the evolution of f n \p (j G Ai\A ), 
but a perturbation applied to f n \ij (j G Ai \ Ao) does not influence the 
evolution of f n \p {i G Ao). 

• ii) The class for which S{\) = A. In this case, if A consists of a single 
element, it is a fixed point. If A consists of more than one elements 
the network formed by S(X) possesses a loop. This means that i G 
S(i) U S(S(i)) U S(S(S(i))) U ■ • • for some indices i. Then, if some 
perturbation is applied to at f n \ji for i contained in this loop, the 
effect propagates through the loop and eventually returns to i itself. In 
this case, we say that A is ' entangled' . 

In Figs.^](-2), sets A satisfying S(X) C A are contained within squares 
drawn with broken lines, while entanglements are indicated by loops drawn 
with broken lines. As shown, the network in Fig.||(a) is hierarchical with four 
layers, and there is no entanglement. Contrastingly, the network in Fig.[|(b) 
has two entanglements (two loops). 

The shape of the network is determined by the manner in which intervals 
are related under f n , and the shape can be preserved even if the period of 
each partial function is changed by changing the coupling e. Recall that the 
shape of the network is resulting from the contracting nature of the generated 
map. For this reason the shape can be preserved when a small change is made 
to the parameter e, and the network is stable with respect to the changes in 

7 The direction of the edge is opposite to the direction of the mapping /„. Here the 
direction of the edge is chosen to be in the direction of the propagation of a perturbation 
applied to at one partial function, which is discussed in the next subsection. 

8 We call the generated map g n \ji (i € Ai) a 'meta-map' [0. 
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e. Also, a network can be stable with respect to noise applied to each partial 
function. In the next subsection, we study the effect of noise on the network. 

4.3 Entangled Network 

Dynamical networks in FD systems can possess hierarchy and entanglement. 
As discussed above one difference between a network with entanglement and 
one without entanglement regards the behavior resulting from perturbation. 
In this subsection, we study the effect of noise on dynamical networks. 

If a network is hierarchical and contains no loops (no entanglements), the 
evolution of f n can be ordered unidirectionally: n-independent partial func- 
tions determine an n-independent generated map, which drives n-dependent 
partial functions, which determine an n-dependent generated map, which 
drives other n-dependent partial functions, and so forth.^ In this case, the 
hierarchy of relations among partial functions is uniquely ordered through 
generated maps. 

Now, we consider how a perturbation applied to one partial function prop- 
agates. For this purpose, we apply "noise" to one partial function, changing 
fn\A to f n \A + 81 A , with 5 as a small number. Here the noise is added only at 
the n-th step, and later time evolution of the function is given by (1) without 
noise. We now study how the effect of such a perturbation is transmitted 
through the network. 

In the case of a hierarchical network without entanglement, this noise 
propagates in one direction. In this case, there are three types of noise 
effects: 

i) Noise destroys the network, and a new network appears. 

ii) The effect of the noise disappears due to the contraction induced by the 
generated map. 

iii) The effect of noise propagates unidirectionally the network, while the 
shape of the network is preserved. In this case, only the phase of oscillation 
of each partial function f n \A is changed. 

If the noise amplitude 5 is not too large, the network shape is not de- 
stroyed, and the only important effect is that of type (iii). In this situation, 
the phase change of a partial function causes a phase change of the corre- 
sponding n-dependent generated map. As a result, the phase of the partial 
function driven by this generated map changes, and so forth. Hence, the 

9 In Ref.^j, this hierarchy is represented by meta-meta-... maps. 
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noise effect for a sufficiently small amplitude 5 in such a hierarchical net- 
work consists of represented as unidirectional propagation of phase changes 
through the network. 

In the case of a network with entanglement, another type of noise effect, 
which is caused by loops, appears: 

(iv) The noise effect circulates through a loop and leads to a transition to a 
new attractor. 

In this case, the noise propagates unidirectionally in the loop and returns 
to the element to which the perturbation was applied. This returned noise 
changes the generated map again, and this effect, if it does not decay away, 
returns to the same element again. Due to the continuation of this process, a 
new attractor on the loop is formed. This behavior is in strong contrast with 
that seen in hierarchical networks without loops, in which only the phase of 
oscillation is changed. 

4.3.1 Simple Entanglement: An example 
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Figure 6: (a) The graph of a limit function f n (for n = 1000-1026). Here, 
1/3 + 1/20, a 2 = 2/3 + 1/10, a 3 = 1/10, a 5 = 1/3 + 1/10 and e = 0.11. 



The period is 26. (b) The network corresponding to this function. There are three 
loops. 



Now, we study the dynamics of a network with entanglement, using sev- 
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eral different initial functions. First, let I = [0, 1] be divided into the subin- 
tervals P = (z/6, (z + l)/6) (i = 0, . . . , 5), and the points {i/6} (i = 0, . . . , 6). 

5 6 

(Obviously, / = ([_J(-T)) U (^J{i/6}.) We define the initial function f accord- 
o o 

ing to Eq.(4), in terms of the parameter aV 

f /o(0/6}) = »/6 



a o 


G I 2 


U/ 3 




= 




a 2 


G/ 4 


U/ 5 


a 3 


G/° 


u/ 1 


a 4 


= 1 




, a 5 o 


G/ 2 


u/ 3 



In Fig.|6](a), an example of the limit function resulting from such an / 
is displayed. In that case, the set of initial values a* were chosen as a° = 
1/3 + 1/20, a 2 = 2/3 + 1/10, a 3 = 1/10, a 5 = 1/3 + 1/10 and e = 0.11 was 
used. In the figure, the graphs of /„ for n = 1000-1026 are overlaid. The 
period of /„ here is 26. 

The network for this function is shown in Fig||(b). As seen, there are 
three loops. It was found that if e < 1/6, the shape of the network does 
not change from the initial time, because the generated map satisfies the 
condition g n \p*\jpi+i C I 2% U I 2t+1 for i = 0,1,2. Due to the nature of fo 
given by Eq.([|), the possible types of network structure are restricted. First, 
the partial functions f n \p and f n \j* are n-independent. The other four f n \p 
are n-dependent and refer to some J 2 - 7 U J 2j+1 (for example, f n (I°) ^ I 2 or 
I 3 ). Thus each of the four n-dependent partial functions refers to either of 
two subintervals at each time step. Accordingly, there are 2x2x2x2 
possibilities at each step. In Fig.[7|, the sixteen possible networks that are 
allowed for this type of initial function are displayed as the directed edges 
S n (i) — > %■ At each time step, /„ corresponds to one of these sixteen possible 
networks. We call the number in the figure the 'state' of the network. Since 
the number of states, 16, is smaller than the period, 26, the network must 
exist in the same state (but with different values of the partial functions) at 
different times in a single period during the evolution. 

The FD system we study can be described in terms of the dynamics of a 
network, consisting of successive transitions between the states defined in the 
above manner. The actual set of allowed transitions between states depends 
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Figure 7: The sixteen possible states of the network at any given time step 
allowed by the initial nature of /o as defined in Eq.(5). 
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(a-1) (a-2) 




1000 1010 n 1020 1030 



(b-1) (b-2) 




Figure 8: In (a-2) and (b-2) are examples of the sequence of transitions between 
states for the FD system with e = 0.11. The initial function in (a-1) is defined by 
Eq.(5) with a° = 1/3 + 1/20, a 2 = 2/3 + 1/10, a 3 = 1/10, a 5 = 1/3 + 1/10, and 
[note that fo(I°) ^ fo(I 5 )], and the initial function in (b-2) is defined by Eq.(5) 
with a° = 1/3 + 1/10, a 2 = 2/3 + 1/10, a 3 = 1/10, a 5 = 1/3 + 1/10 [note that 
/o(/°) = /o(^ 5 )]- (a-1) and (b-1) depict the evolution of the state from n = 1000 
to n = 1030. The period of the sequence of transitions depicted in (a-1) is 26, and 
that of the sequence depicted in (b-1) is 20. In (a-2) and (b-2), the possible sets of 
transitions are depicted. Here (a-2) corresponds to the case fo(I°) ^ fo(I 5 ), and 
(b-2) corresponds to the case fo(I°) = fo(I 5 ). These two figures depict the two 
types of transition sets possible in general, while the actual transitions possible 
for any given choices of fo will consist of some subset of these. For the particular 
choices considered here, only the transitions denoted by solid arrows occur. 



on the initial values a l . By examining the FD of each partial function, case 
by case, one can show that possible sequences of transitions are of two types, 
as defined in Figs.|](a-2) and |](b-2). These two types correspond to the cases 
in which fo(I°) ^ fo(I 5 ) and fo(I°) = fo(I 5 )- There are two types of possible 
sets of transitions exhibited by the FD system, depicted schematically by 
Figs||(a-2) and (b-2). Each type includes the transitions denoted by both 
solid and broken arrows in the figures, but for given a l Q, the actual transition 
sequence includes only some of the transitions indicated. For the particular 
choices of fo considered here, only the transitions denoted by solid arrows 
occur. 

Two examples of the sequence of transitions between states starting from 
two different initial functions are plotted in Fig.8. Here, two actual sequences 
of transitions between states from n = 1000 to n — 1030 are plotted in 
Figsj^(a-l) and (b-1), where fo(I°) = fo(I 5 ) is satisfied in (b-1) and not in 
(a-1). As shown in Fig.||, the set of possible transitions depends on whether 
fo(I°) = fo(I 5 ) is satisfied or not. This set in the former case is depicted 
in (b-2) and in the latter case in (a-2). (Note that these sets of transitions 
characterize long-time behavior, i.e., after transient behavior has ended.) 

Now, the function f n on an attractor is characterized on three levels, 
according to i) the value of f n \p, ii) the state of the network, and iii) the set 
of possible transitions given in Figs.|S](- -2). 

4.3.2 Transitions among Attractors in Entangled Networks 

As discussed above, the behavior of the network dynamics in a FD system 
depends on the initial conditions, represented by the values a l . Although 
the parameter characterizing the FD model, e, is fixed, the change undergone 
by the FD attractor as the a* are changed is bifurcation-like, because the 
generated map changes with the values of the aV To elucidate the depen- 
dence on the initial conditions, we carried out numerical simulations using 
the definition given in Eq.(5), employing various values of a°o, with all other 
a l o (i = 1, . . . 5) values fixed. In Fig|| the values a° n on an attractor (after 
transients) are plotted with respect to a°o- The solid curve represents the pe- 
riod of the attractor of f n resulting from the corresponding initial value a° . 
The flat pieces of this curve express the meaning that over the corresponding 
interval of a°o values a° n is on the same attractor. The stability of attractors 
with respect to changes of a°o that the existence of these flat pieces reflects 
arises from the property that the slope of the generated map is less than 
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unity. The discontinuities of this curve are caused by discontinuities of f 
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Figure 9: The limiting values of a° n respect to oPq. Here, a 2 o = 2/3 + 1/10, 
a 3 = 1/10, a 5 = 1/3 + 1/10 and e = 0.11. The period of a° n (which is also the 
period of /„) is plotted by the solid curve. 

By applying a perturbation to an attractor, a transition between attrac- 
tors can result. Such a transition, on the other hand, can be understood 
as a propagation of noise through the network, as mentioned above. To see 
how such noise can propagate, we applied an instantaneous "noise" to f n \io, 
for sufficiently large n that /„ is on an attractor. (We took n = 1000 avoid 
transients.) We computed the time evolution of the function after this per- 
turbation, which is denoted h n , and then measures the difference d l n between 
h n and the unperturbed f n : d l n — h n \ji — f n \n. In Fig.[L(], time series of cf n 
are plotted. 

The transitions among attractors progress as follows. At n — 1000, the 
instantaneous noise is added. This noise first is transmitted to f n \i 3 (see 
Fig.^|(c)). However, the effect of the perturbation decays on J° and I 3 , as 
seen from c?° plotted in (a) and plotted in (d) of Fig.|l0|. Then, / n |/5 is 
influenced by the noise. Through J 5 , the noise effect is conveyed to / n |/2, 
as seen in (b). For n ~ 1040, the value of f n \p changes and this effect is 
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Figure 10: The time series of the difference, d n , between the original function 
f n and h n , obtained by perturbing f n \jo at n = 1000. (a)d° n , (b)d 2 n , (c)d 3 n , 
(d)d 5 n . The initial function used here is defined by Eq.(5), with a°o = 1/3 + 1/20, 
a 2 = 2/3 + 1/10, a 3 = 1/10, a 5 = 1/3 + 1/10. We also used e = 0.11. Note that 
the scales of the vertical axes differ among the figures. 
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transmitted back to / n |jo. Hence, the noise effect circulates between J° and 
J 2 , and for n > 1040, f n \p acts as a 'pulse generator'. Here, the amplitude 
of the 'pulse' is of the same order as the noise. Note that the magnitude of 
d l n is of a different order on each P: (a) d° n ~ 10~ 3 , (b) d 2 n ~ 10~ 2 , (c) 
d 3 n ~ 10~ 4 , (d) d 5 n ~ 10~ 3 . The noise effect is amplified on I 5 and is further 
amplified on I 2 . From this point of view, we can consider the added noise 
to be stored in f n \p, which leads to a transition to a new attractor. This 
transition is possible because the network is entangled. In this case the noise 
effect returns to the interval where the noise was originally added. Then, 
deviation from the original attractor is sustained within the loop in which 
the noise effect is circulated. Hence the function switches to a new attractor. 



4.4 Memory in a Dynamical Network 

As is already discussed in Ref.0, our FD can be regarded as a system that 
transforms input to output through f n (x), with an input-output relationship 
that changes autonomously. Since such an autonomous change of an input- 
output relationship is commonly observed in biological cognitive systems, it 
is interesting to consider the possible function of an entangled network in 
this context. 

When our function /„ is regarded as defining an input-output relation- 



ship, the Qq-Oq relation in Fig. 10 represents the input dependence of the 



output. This relationship exhibits several thresholds with regard to change 
in the output behavior; when the input is changed beyond such a thresh- 
old, the output switches to new behavior. This switch can be caused by 
perturbing a partial function. The pulse generated by such a perturbation 
can be regarded as a memory. Within a network with loops, the input (a 
perturbation applied to one partial function at one time step) is memorized 
through the propagation of noise within the loop. Note that for this type of 
network, i) the attractor can be changed as a result of this noise through a 
transition process and that ii) information can be stored in some parts of the 
network by virtue of the circulation of the input. It would thus appear that a 
dynamical network of this kind has the potentiality to possess memory that 
depends on an input. 



5 Summary and Discussion 
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5.1 Summary 

In the present paper, FD has been studied by constructing initial functions 
suitable for analytical and numerical study, after basic introduction to a FD 
model in Sec. 2. 

It was shown that the dynamics of a FD system are represented by a gen- 
erated map, a 1-dimensional map g n determined by the 1-dimensional map f n . 
The generated map acts as the rule governing the temporal evolution of f n {x) 
(i.e., f n+ i(x) is determined by g n ). For most initial conditions, after tran- 
sient behavior dies away, the function f n is attracted to a piecewise-constant 
function. In other words, f n comes to be divided into partial functions, each 
of which is constant. In Sec. 3, the stability of these piecewise-constant func- 
tions was discussed. In Sec. 4 we considered the behavior resulting when we 
start from a piecewise-constant function, where each constant partial func- 
tion is regarded as an element of a network. The dynamics of such a network, 
which generate a rule to drive the network itself, were also studied in Sec. 4. 

After defining initial functions appropriate to allow for the behavior de- 
scribed above in Sec. 4.1, the dynamics of the resulting type of network were 
classified in Sec. 4. 2. In one class, the dynamics of the partial functions are 
determined hierarchically. These partial functions are unidirectionally or- 
dered in a tree, in which each partial function in an upper level is driven by 
partial functions by lower levels. In this case, the effect of a perturbation ap- 
plied to a partial function is transmitted unidirectionally through the partial 
functions. 

In Sec. 4. 3, we studied another class of network dynamics, that in which 
there is 'entanglement', in the sense that dynamics of some partial functions 
are influenced by other partial functions. The structure of such entangle- 
ment, i.e., the mutual influence of different partial functions on the rules 
for their dynamics, was analyzed. In Sees. 4. 3.1 and 4.3.2, this entanglement 
was studied by considering particular sets of initial conditions. It was shown 
that a perturbation (representing an input to one partial function) circulates 
through a loop in the network, and as a result, the network dynamics can 
switch to a new attractor. The ability of this network to model a memory 
was discussed. 

In conclusion, we have found that the FD system we have studied can 
form a hierarchically entangled dynamical network. We believe that such 
a system may be useful in modeling the spontaneous emergence of rules 
governing dynamics in biological system. 
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5.2 Dynamical Network 

In general, a network consists of elements and directed edges between ele- 
ments. Information is transmitted through directed edges, and the internal 
state of an element (i.e., the value of the partial function) changes accord- 
ingly. The terminal of a given directed edge depends on the dynamics of this 
internal state. 

In this paper, the function of a FD system is represented by a network 
according to the following prescription: 

• An element in the network consists of a connected subinterval on 
which the value of the function f n (x) is constant. According to the re- 
sults of our simulations, it appears that the formation of such constant 
subintervals is a general characteristic of FD systems, as discussed in 
Sec. 3. 

• Directed edges are determined by the relations among the intervals 
induced by f n . Specifically, if f n (A) C B is satisfied, there is a directed 
edge from B to A, represented as B —>■ A in the graph of a network. 

• The internal state of the element A is defined as the value / n U(^)- 

• The transmitted information from B to A is the value / n |s(^)- 

The shape of a network changes through the change of its directed edges. 
For example, the edge B — > A changes to C — » A, if g n o f n (A) C C. With 
this representation, a dynamical network for a FD system can be formulated. 

The advantage of a FD model lies in the simultaneous formation of el- 
ements and edges. Through the FD, elements and edges emerge from an 
infinite-dimensional functional space. In most studies of dynamical networks, 
a fixed set of elements along with rules that govern the evolution of the edges 
are prescribed. Q However, many biological (including cognitive and social) 
systems have the ability to generate rules governing their dynamics sponta- 
neously. As a simple example, consider signal transduction in a cell. There, 
signal molecules change the state of a cell, and play a role in determining 

10 This holds for all neural network models, and if also holds for the models used in 
recent studies of networks || @, || . 
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the dynamics. However, the results governing this function are not neces- 
sarily prescribed by chemical reaction rules, but are determined by the state 
of the cell, which is realized through the reaction network dynamics. It is 
true that investigation to elucidate the microscopic dynamics involving sig- 
nal molecules is important to understand such context-dependent functions 
of signal molecules. However, it is also necessary to adopt an approach from 
a higher, macroscopic level, which can be represented by a functional sys- 
tem. Of course, the same can be said about a cognitive systems consisting 
of neurons. 

The FD approach is based on self-referential structure represented by 
fn ° fn, which was introduced to understand how elements and rules are 
generated simultaneously and interdependently. The fixed point f n (x) — f n o 
f n (x) represents a self-consistent condition in which operation by the function 
does not change the function itself. This fixed point determines intervals on 
which the function is constant. These intervals act as the basic elements in 
the network, and drive other intervals. The constant intervals formed due to 
fixed points provide rules governing the dynamics of the other intervals. The 
network thus generated can possess hierarchy and entanglement. 

Hierarchy in a network is commonly observed in biological (as well as 
cognitive and social) systems. In some cases, such hierarchy is simple, and 
the network possesses a tree structure. In some other cases, the hierarchy is 
not simple, and the network is entangled; i.e., there exists mutual dependence 
of the dynamics of elements. In such the network itself changes 

spontaneously. Such network dynamics can also be changed with inputs. 
Features of this kind that exist in real biological networks were also shown to 
exist in our FD system in this paper. Considering the simplicity of our model 
(1), the results found here give reason to believe that these features exist quite 
generally in network systems that maintain themselves through temporal 
evolution. It is therefore important to study how concepts formulated with 
regard to FD can be applied to real biological network dynamics. 

5.3 Future Problems 

The limit function investigated here starts from a piecewise constant function 
/o. However, in a more general investigation, we also need to consider the 
case in which such initial functions are continuous. With a continuous fo, the 
limit function can consist of an infinite number of constant partial functions. 
We believe that infinite hierarchy and infinite entanglement can be generated 
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in this case. Characterization of the dynamics in a system with such infinite 
hierarchy is a future problem. 

The stability of a higher-order structure, such as hierarchy and entan- 
glement in a network, is an important problem in FD. Though the theorem 
stated in Sec. 3 is valid only for an n-independent partial function (although 
we hope to generalize it in future), we believe that attractors in a FD system 
are stable, because the slope of the generated map is 1 — e. 

By adding noise (i.e., an input to one or more partial functions) with 
a finite magnitude, a transition between attractors can occur. Consider a 
perturbation applied to the system by changing the value of f n \p- As a re- 
sult, any partial function f n \p that satisfies f n \jj C I i is influenced by this 
change in f n \n. In this manner, applied noise is transmitted along edges in 
the network. During this transmission, the noise 1) will decrease due to the 
contracting nature of the generated map g n , but 2) it may cause a transition 
to a new attractor for each f n \ji when the noise causes f n \jj to switch to a 
new branch in the generated map. (Note that the generated map is discon- 
tinuous.) If a transition to a new attractors does not occur for any n, the 
influence of the noise eventually disappears, due to the contraction imparted 
by the generated map. 

Considering the successive addition of inputs (noise), one can study how 
the inputs are 'memorized' in the network. Note, however, that there is a 
difficulty involved with the continuous addition of noise in our model. Also, 
when noise is added to fixed points, the network structure may be completely 
destroyed] 11 ! Indeed, in a FD system with noise added continuously in time, if 
the magnitude of this noise is sufficiently large, the function becomes constant 
over all intervals. One possible way to avoid this problem is to consider a FD 
on a torus (S l ), i.e., a map on a circle. In this case there exists a function that 
has no fixed points. The study of FD on a circle is an interesting extension 
to be considered in the future. 

n If the noise is applied instantaneously, in most cases, the n-independent function 
around the fixed point changes to a new n-independent function around a new fixed 
point, and the structure of the network is preserved. 
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